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seta ise The proposed approach has two distinct features: first, 
seleetanenafsPM locations with optimum access delay where the VMs are required to be 
mighalied, and second, reduces the number of VM migrations. Extensive simulation 
exeff#ents have been conducted using the CloudSim toolkit. The results of the proposed 
approach are compared with the PACPA and RUAEE algorithms in terms of Service-Level 
Agreement (SLA) violation, resource utilization, number of hosts shut down, and energy 
consumption. Results show that proposed EAMA approach significantly reduces the number 
of migrations by 16% and 24%, SLA violation by 20% and 34%, and increases the resource 
utilization by 8% to 17% with increased number of hosts shut down from 10% to 13% as 
compared to the PACPA and RUAEE, respectively. Moreover, a 13% improvement in energy 
consumption has also been observed. 
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q=VM+tplacement); CloudSim (/search?q=CloudSim); cloud computing (/search? 
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1. Introduction 


Cloud computing has revolutionized industry and academia by the provisioning of on- 
demand computing resources. These on-demand resources are based on pay-as-you-use. 
Organizations and individuals outsource Cloud services for the diverse nature of tasks that 
demand high-performance computing, large memory instances, licensed software 
applications, large-scale simulations [1] and development platforms, etc. Specifically, 
organizations prefer to outsource Cloud services rather than designing their own private data 
centers for their business needs due to the huge investment, maintenance, and management 
cost. The high demands of organizations for Cloud services resulted in the establishment of 
large-scale Cloud Data Centers (CDCs). Enormous energy consumption is a bla Aopen in 
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reasanE for excessive energy consumption in CDCs are inefficient use of resources and 
> Referenc 
i e Vrun Machine (VM) placement on hosts (overloading and under-loading), etc. 
When 4 host utilizes all available resources and demands more resources to complete the 


user jobs, this state is called host overloaded. The host is said to be in an under-loaded state 
if the resources of the hosts are below or equal to a certain utilization threshold. The host 
overload problem further leads to the Service-Level Agreement (SLA) violation [8]. In general, 
SLA violation is considered a bad experience for the provisioning of Cloud services to the 
Cloud customers, which means that Cloud customers would not be satisfied with the Cloud 
services. Therefore, Cloud providers have to pay a penalty to the customers based on the 
SLA agreements. 

If a host experiences an under-loaded problem in the CDC, all Virtual Machines (VMs) of 
that host are migrated to other hosts using live migration [9] and concerned under-loaded 
hosts are then powered off accordingly. In this way, the number of active hosts is reduced 
across the CDCs which ultimately leads to reduced energy consumption. However, 
aggressive consolidation of VMs can cause performance degradation due to the high 
demands of resources. Moreover, if the required resources are not available to the application 
for its processing, it will ultimately lead to an increase response time, which may result in 
application failure or late response. Numerous approaches have been proposed by 
researchers to improve the resource utilization with reduced energy consumption in CDCs. 
Dynamic VM consolidation and management approaches proposed in [10,11,12,13,14,15,16] 
have shown improvements in the energy consumption. These VM consolidation approaches 
provide benefits of dynamic workload adjustment, where the VMs are periodically re-allocated 
according to their demands of resources. Although these approaches minimize the number of 
active hosts in the CDCs, most of these approaches ignore the SLA requirements and 
efficient use of resources. Few dynamic approaches conduct aggressive consolidation of 


VMs, which leads to SLA violations and inefficiencies in the utilization of resourdeek Moines, 
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The rest of the paper is organized as follows. The related work is presented in Section 2. 
In Section 3, the proposed approach is delineated. The simulation setup is presented in 
Section 4. Section 5 illustrates the results and discussion. In Section 6, the comparative 
analysis and recommendations are discussed. Finally, Section 7 presents the conclusions 
and future work. 


2. Related Work 


In the last few years, a number of approaches have been proposed to resolve the VM 
migration and placement problems across the CDCs in the context of Cloud computing. 
Nathuji and Schwan [17] presented an architecture of CDC resource management that 
partitions the resources into local and global components. The operating systems are 
leveraged at the local level for power management strategies. A global manager is 
responsible for obtaining the resource allocation information for the VMs placement. 
Arroba et al. [18] proposed a Dynamic Voltage Frequency Scaling (DVFS) policy to optimize 
the energy consumption in CDCs while considering the QoS and mapping of VMs to the 
resources. The authors performed simulation experiments using the CloudSim toolkit and 
proved that the proposed DVFS manages workload across the CDC in an appropriate 
manner and saves 41.62% energy under dynamic workload conditions. Reddy et al. extended 
the Particle Swarm Optimization (PSO) in [19] by contributing a Modified Discrete Particle 
Swarm Optimization (MDPSO) approach. For VM selection, the authors presented the 
Memory Bandwidth and Size (MBS-VM) algorithm. The MBS-VM selection algorithm selects 
the VMs from the under-loaded and overloaded PMs for migration. The authors optained in the 
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MANES ISSR Results show that the proposed algorithms outperformed the PABFD 
ogg by reducing energy consumption with decreased number of active hosts, VM 
migrations, and SLA violation. 

~ To reduce energy consumption in CDCs, the authors of [21] consider CPU 
temperature/cooling infrastructure, server workload, and dynamic workload using a novel 


scheduling algorithm called GRANITE. The proposed technique reduces the energy 


consumption as well as the probability of critical temperature violations by 99.2%, and keeps 
a low SLA violation rate of 0.17%. 

An improved genetic algorithm for efficient VM scheduling is proposed in [22]. 
The proposed algorithm keeps CPU utilization up to the specified threshold and below the 
host’s capacity. In this approach, chromosomes denote each physical machine and the virtual 
machines are considered genes of the chromosomes. This approach allocates the tasks and 
VMs in such a way that reduces the overall energy consumption of the CDC. 

The authors of [23] present a unique scheduling algorithm called Static Scheduling using 
Chemical Reaction Optimizer (SS-CRO). The SS-CRO approach test schedules with different 
instructions dependencies before making the selection. It provides different schedule orders 
and considers the most optimum scheduling solution. The proposed approach was evaluated 
experimentally as well as analytically and compared with Static Scheduling using Duelist 
Algorithm (SS-DA) and Static Scheduling using Genetic Algorithm (SS-GA) approaches. 
The obtained results show that the proposed approach achieves higher accepted solutions 
and better execution time. 

Karda and Kalra designed a novel algorithm entitled Ant Colony Optimization (ACO) 
in [24], which places VMs on the physical hosts while considering the CPU utilization. ACO 
maps VMs on those hosts that have no probability to be overloaded in the future. Host 
selection for VM placements is initiated in such a way that it provides the benefits of minimum 
migrations across CDC. The ACO approach outperformed the existing Thréshold foréegy 
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s on the host and (2) it uses the approximation algorithm to find the approximation 
ratio. The algorithm approximation ratio is better than the other approaches in terms of 
memory and server utilization. The experimental results show that the proposed algorithm 
outperforms as compared to Greedy-Flow and First Fit VM placement approaches and it 
requires 40% fewer memory pages as well as 25% fewer PMs. 

A novel energy-aware cost prediction framework for CDCs is proposed in [28], which 
predicts the workload, power consumption, and the total cost of VMs. This framework 
assesses the cost and workload predictions from the workload patterns. The proposed 
approach is also used to analyze energy pricing for resource utilization and can place the 
VMs in a load-balanced way. 

A load-balancing approach called Cluster Dimension Exchange Method (CDEM) is 
proposed in [29], which focuses on efficient load-balancing on the promising Optical 
Transpose Interconnection System (OTIS)-Hypercube interconnection networks. 
The experimental evaluation and analytical model proved the effectiveness of OTIS- 
Hypercube over Hypercube in terms of load-balancing accuracy, execution time, speed, 
and number of communication steps. A load-balancing approach based on Chained-Cubic 
Tree (CCT) interconnection networks was proposed in [30]. The proposed algorithm is called 
Hybrid Dynamic Parallel Scheduling Algorithm (HD-PSA). This algorithm is a combination of 
two load balancing strategies: parallel scheduling and dynamic load balancing. The proposed 
algorithm performance is evaluated both experimentally and analytically in terms of execution 
time, communication cost, load balancing accuracy, task locality, and number of tasks hopes. 

A Dynamic Resource Allocation (DRA) approach is proposed in [31] by Yang et al. that 
saves energy utilization in CDCs. This approach consists of various steps, i.e., deployment of 
OpenStack-based infrastructure platform for VMs live migration, allocation of dynamic 


resources and energy-saving algorithms, and monitoring of power distribuBiatk to Teecoprd 
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The major issues with most of the VM migration for power efficiency include aggressive 
consolidation decisions, uncontrolled migrations, and non-optimal VM placement [33]. 
To address these issues, we have proposed an efficient VM migration approach, which 
performs VM consolidation across CDCs to maximize the resource utilization and reduce 
energy consumption, while keeping SLA violation to a minimum. 


3. Efficient Adaptive Migration Algorithm (EAMA) 


In this work, we have addressed the problem of VM migration by proposing an Efficient 
Adaptive Migration Algorithm (EAMA). 

The proposed approach consists of four main phases: The first two phases are related to 
the detection of the overloaded and under-loaded hosts. The third phase deals with the VM 
migration from overloaded hosts to under-loaded hosts according to nearby locations. 
The last phase detects the remaining overloaded/under-loaded hosts and initiates the final 
migration and placement of VMs. For VM migration, we extended the SIM-Cumulus 
framework [34] by adding a Migration Management module (as shown in Figure 1). The 


Modified SIM-Cumulus comprises four layers: System Accessibility Layer (SAL), Cloud 
Back to TopTop 
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Jhigapiocess continues until all overloaded PMs go to normal states. At the end of this step, 
a Re =i Temaining overloaded or under-loaded PMs is returned to the final migration 
algorithm. In last step, if there are some remaining overloaded/under-loaded hosts, the VMs 
are migrated to normal or new hosts. Moreover, the under-loaded PMList is divided into two 
halves called the First Half List (FHL) and Second Half List (SHL). The VMs in the FHL PMs 
are migrated to the PMs of the SHL. Once all the PMs in the SHL becomes normal, the VMs 
from the remaining PMs are migrated to new or other normal PMs. The detailed discussion 


about each phase is discussed in next subsections. 
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Figure 2. VM migration flowchart. 


3.1. Overloaded Host Detection 


After the initial allocation of VMs, the algorithm periodically analyzes the overloaded PMs 
across the data center. The overloaded host detection algorithm detects the overloaded hosts 
running in DC and places overloaded hosts into the overloaded host list, and this list is then 
passed to the migration and placement algorithm. Algorithm 1 performs the detection of 
overloaded hosts in CDCs. The input parameters pmUtilization, pmTotalCapacity, and 
overUtilizedPmList are declared in lines 1 to 3. In Algorithm 1, line 4 evaluates all the PMs in 
the Cloud data center one by one for overloaded host detection. Line 5 of the Algorithm 1 
represents the PM’s total capacity in MIPS. The total MIPS capacity corresponds to all the 
MIPS which are allocated to PM in the data center. At line 6, the Algorithm 1 gets the current 
utilization of MIPS of the PM. The Algorithm checks the current utilization of PM in line 7; if it 
is equal to or greater than the total MIPS of the PM, then the PM is placed to the 
overloadedPMsList. This list is then passed to the migration and placement algorithm. 


Algorithm 1 Overloaded Host Detection 
Back to TopTop 
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{v 
Miris phase, all PMs that are running below a lower threshold is detected. The lower 
threshold in our approach is 30% of a host total CPU (MIPS). A list of under-loaded hosts is 
populated at the end of this phase and is passed to the migration and placement algorithm for 
VMs migration. 

Once all the overloaded hosts are detected, the next step is to find out the list of hosts 
that are in the under-loaded state. 

Algorithm 2 detects the under-loaded hosts in CDC. The hosts’ utilization is checked 
according to a lower threshold. Parameter pmTotalCapicity holds the total MIPS capacity of a 
PM. Parameter pmUtalization holds current utilized MIPS of a PM. maximumUtalization 
contains the lower threshold value. At line 4 (of Algorithm 2), foreach analyzes all the PMs in 
the data center one by one. The lower threshold is defined on line 7. At line 8 (of Algorithm 2), 
if the current utilization of PM is less than or equal to the lower threshold value, then this PM 
is considered as under-loaded. The under-loaded PM is placed in under-loadedPMsList. lf the 
current utilization of PM is greater than the lower threshold, then the next PM will be 
analyzed. After evaluating all PMs in the DC, a list of under-loaded hosts under- 
loadedPMsList is prepared. This list is returned to the migration and placement algorithm for 
the final migration and placement of VMs. 


Algorithm 2 under-loaded Host Detection 
Input: PMņis = List of PMs (i. e., PM ,, PM, PMs3,...,PMn) 


Output: wnderloadedPMsList 


1: pmutilization — 0 
2: pmTotalCapacity — 0 


3: lowerThreshold — 0 Back to TopTop 
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RA pipimu delay). After overload and under-load host detection, the next step is to 


mi as 3 the VMs from the overloaded hosts to the under-loaded hosts as given in Algorithm 3. 
Th migration and placement algorithm is used for VM migration and placement Hm 


overaaded PMs to the under-loaded PMs according to a nearby location. The nearby location 
gives the minimum delay in services provisioning to the Cloud user that is possible if the VMs 
are migrated to nearby located DCs. The algorithm obtains the list of overload/under-loaded 
PMs from the overloaded host detection algorithm and under-loaded host/detection algorithm. 
The under-loaded PMs are then sorted in descending order for VMs migration. At first, 
the algorithm places VMs from overloaded PMs to the under-loaded PMs. The algorithm 
analyzes the overloaded PM from the overloaded PM list (line 7, Algorithm 3). VMs of the 
selected overloaded host are sorted in ascending order by their MIPS utilization. At line 11, 
the algorithm compares the size of VM in MIPS with the available capacity of the under- 
loaded PM. If the capacity on the under-loaded PM is enough to service the VMs, then the 
VM is placed to the under-loaded PM; otherwise, the next PM is selected for the VM. 
After migration of VM from overloaded PM to the under-loaded PM, according to a nearby 
location, the selected under-loaded PM goes to the normal utilization list (line 14, Algorithm 
3). This process continues until all overloaded PMs go to normal utilization. At the end of 
execution, a list of remaining overloaded or under-loaded PMs is returned to the final 
migration algorithm. 


Algorithm 3 VM Migration and Placement 
Input:underloadedPMsListandoveroadedPMsList 


Output:underloadedPMsList 


1: overloadedPMsList 
2: underloadedPMsList 


3: undrloadedPMs. sortDec() 
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e < underloadedPM. size) && (underloadedPMs. DC. delay. smallest) ) then 


PlaceVM(underloadedPM, VM) 


addNormalList\ (underloadedPM, PM. ID) 


20: end if 

21: end if 

22: if ((underloadedPMlist == 0) && (RemOverLoadedHosts == 0)) then 
23: break; 

24: end if 

25: end for 

26: end for 

27: end for 


28: Return underloadedPMsList 


3.4. Final Migration 


This is the final phase of our proposed algorithm. In this phase, if there are some 
remaining overloaded/under-loaded hosts, the VMs are migrated to normal or new hosts. 
The final migration is executed once the under-load and overload hosts detection being 
finalized and the VMs from the overloaded PMs are migrated to some of the under-loaded 
PMs. The final migration algorithm gets the remaining overloaded and under-loaded PM lists 
from VM migration and placement algorithm. The algorithm divides the under-loaded PMList 
into two halves called the First Half List (FHL) and Second Half List (SHL). The VMs in the 
FHL PMs are migrated to the PMs of the SHL. Once all the PMs in the SHL becomes normal, 
the VMs from the remaining PMs are migrated to new or other normal PMs. Migrating in this 
way has two benefits: the number of migrations is reduced and the number of host shutdown 


is increased. Algorithm 4 moves the VMs from the FHL PMs one by one by comparing the 
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Ee WM eaSeeqnahalf UnderPM do 
° eS eae size < FHPMs) then 


pa PlaceVM(FHPMs, VM) 
Cgmment Break 


10: if (FHPMs. utilization == 0) then 
11: Break 

12: end if 

13: else 

14: Break 

15: end if 

16: end for 

17: endfor 

18: end for 


3.5. RAUEE and PACPA Approaches 


In this subsection, a brief overview of two contemporary migration approaches 
(compared in this work) is presented. The work in [35] proposed an energy-efficient server 
consolidation approach that has increased the resource utilization and reduced the number of 
live migrations across the CDC. The RUAEE model works in four sections: finding the 
overloaded hosts, adjusting the unbalanced machines, under-loaded host selection, and 
finally placement of VMs. At the start, the overloaded module classifies the hosts into either 
normal hosts or overloaded hosts. In the next module, it then finds out the unbalanced hosts 
to be used for workload adjustment. In the third step, the low-utilized machines are detected 
using the SF value and then migrating all running VMs to power off to save energy. In the last 
step, the hosts are selected for final VM migration using the VM placement module. The 
PACPA algorithm predicts the short-term CPU requirements of the VMs that RES ofr RE 
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~seembproaches are costly and are difficult to configure and thus sometimes nee 


$etercgsthe testbeds for experiments. Moreover, executing the simulation Sai 
tinfésfenmtee real Cloud platform may result in high monitory cost, whereas the analytical 
appfmliches are often limited in evaluating the migration approaches. Therefore, the 
sifon approaches are widely employed for performance evaluation of the underlying 
migration techniques using a variety of configurations. To evaluate the performance of the 
migration approaches including the proposed EAMA approach, Cloudsim [36,37] simulation 
platform is employed. The simulation experiments were performed on a workstation equipped 
with Intel Core i5-8500 Quad-core processor (3.0 GHz clock speed) and 8 GBs of main 
memory. Table 2 shows the details regarding the parameters (i.e., total data centers, number 
of PMs, and number of VMs) used for the simulation. 


Endor 


Table 2. Simulation parameters. 


5. Result and Discussion 


Obtained results of the proposed EAMA approach are compared with PACPA [11], 
RUAEE [35] in terms of SLA violation, energy consumption, number of hosts shut down, 
resources utilization, and number of migrations. The proposed EAMA approach migrates and 
places VMs on the PMs in a way that results in a reduced number of migrations with 
minimum SLA violation and better resource utilization. The proposed approach migrates VMs 
from overloaded PMs to under-loaded PMs according to the location of VMs/users, thus 


making the proposed approach superior over the compared approaches in tank f Taetdes 
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‘genus are obtained and illustrated in Figure 3. In Figure 3, the X-axis 
feces SSI nts the migration approach, and resource utilization (i.e., CPU) is plotted on the Y- 
axis. is. The EAMA approach leads to 88% resource utilization showing 8% and 17% 
improvement as compared to the PACPA and RUAEE approaches, respectively. The obtained 
results assert the effectiveness of the proposed approach against the existing compared 


approaches. 
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Figure 3. DC resources utilization. 


The energy consumed metric is another important parameter used to evaluate the 


performance of any given migration algorithm across the Cloud data centers. To evaluate the 
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where y u(t) corresponds to the utilization of CPU at time t. CloudSim has two servers used for 
power consumption calculation: one is HP ProLiant ML110 G4 and the other is HP ProLiant 
ML110 G5 [39]. Figure 4 demonstrates the energy consumption in the DC for the proposed 
EAMA and existing approaches (i.e., PACPA [11] and RUAEE [35]). The improvement in 
resource utilization also has a clear impact on the energy consumption. The proposed EAMA 
approach reduced the energy consumption by approximately 13% as compared to the 
existing (PACPA and RUAEE) approaches. This is due to the fact that migration was 
performed in a controlled way by firstly migrating the VMs from the overloaded PMs to the 
lowest under-loaded PMs. Then, the rest of the under-loaded PMs are divided into two 
halves, where VMs from one set of under-loaded PMs are migrated to another set of under- 
loaded PMs. 


Back to TopTop 
https:/Awww.mdpi.com/2073-8994/13/4/690 18/37 


09/06/24, 23:52 Symmetry | Free Full-Text | EAMA: Efficient Adaptive Migration Algorithm for Cloud Data Centers (CDCs) 


DKTS 
a FL, Arload PDF (12073-8994 13/4/690/pdf?version=1618815803) Order Article Reprints (/2073-8994/13/4/690/reprint: 
UN : 
I i OQU o 


° Related Work esktop layout cookie) Q = 
ent Adaptive Mig 

Algorithm (EAMA) 

°” Sirplation Setup 

° RéSult and Discussio! 


° Jihparative Evalue Evaluati 


°” Garslusions and Futt 20 


SciProfiles 
° man: Contributions 


0 
“a FARAURS public/10.: 3: PACPA RUAEE EAMA > 
Dale Availabiinn plats Migration Approach iscuss in_sciprofiles) 


° Acknowledgments 


° AMicis of Interest 


Endorse 


° References 

ala violation occurs when the hosts reach their 100% CPU utilization and the user 
apestion still requires more CPU for its execution. Equation (4) corresponds to the SLA 
violation calculation [33]. In the given equation, SLA violation is calculated with respect to 
time: 


80 


60 


40 


Energy Cons. (Kw/Hour) 


Figure 4. Energy consumption comparison. 


Z Tsi 
SLA Voilation = ) T. (4) 
i1 “i 


where Tą is the time when the host is in violation and 7T,; shows the hosts total active time 
[33]. Figure 5 plots the results of SLA violation for the EAMA and compared approaches. The 
proposed approach reduces the SLA violation by 20% and 34% as compared to the PACPA 
and RUAEE, respectively. The obtained results advocates the effectiveness of the proposed 
approach for VM migration in the Cloud DCs. 
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Mure 6 plots the results concerning the number of hosts shutdown. One of the 
objectives of the proposed EAMA approach is to reduce the number of active hosts in the 
Cloud DC. The proposed approach leads to a reduction in the number of active hosts. It can 
be seen from Figure 6 that the proposed EAMA approach reduced the number of hosts shut 
down by 10% and 13% as compared to PACPA and RUAEE approaches, respectively. 


40 
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Figure 6. Number of hosts shut down. 


Finally, Figure 7 provides details regarding the number of VM migrations. From the 


obtained results, 16% and 24% reductions in the number of migrations is observed for the 
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Figure 7. Number of migrations. 


6. Comparative Evaluation 


Following the experimental results and discussion, the comparative evaluation is 
delineated to extract important findings regarding the proposed approach against the 
compared migration approaches. The behavior of three different migration approaches 
including the proposed EAMA approach was investigated empirically concerning various 
performance metrics. Among the compared approaches, the proposed approach showed 
substantial performance concerning the number of migrations, resource utilization, SLA 
violation, host shutdown ratio, and energy consumption. The efficiency of any migration 
approach depends on the strategy used for the VM migrations. The proposed approach has 
been able to reduce the number of migrations by 16% and 24% against the PACPA and 
RUAEE, respectively. This is because migration was performed in a controlled way by first 
migrating the VMs from the overloaded PMs to the lowest under-loaded PMs. Then, the rest 
of the under-loaded PMs are divided into two halves where VMs from one set of under-loaded 
PMs are migrated to another set of under-loaded PMs. Migration in this way has three 
benefits: First, the number of hosts shutdown is increased, thus leading to better resource 
utilization; second, the number of migrations is also reduced; and third, reducing the chances 
of powering on the new PMs. From the user’s point of view, the SLA is considered as one of 


the most important criteria in selecting the best Cloud service provider. Another important 
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Refere 
coges Tor optimal migration of the VMs. The efficient resource utilization has several 
impacts like the maximal utilization of the existing resources, powering off the underutilized 


machines, and most importantly resulting in improved energy consumption. The proposed 
approach not only reduced the number of migrations, but also led to better consolidation of 
the resources. The EAMA approach reduced the number of hosts shut down by 10 to 13% as 
compared to the contemporary approaches (i.e., PACPA and RUAEE, respectively). For the 
last few years, energy consumption has been considered an important parameter to evaluate 
the performance of various approaches concerning the Cloud computing. This work also 
utilized the energy consumption metric to evaluate the performance of the proposed EAMA 
approach against the approaches considered for comparative analysis. The proposed EAMA 
approach reduced the energy consumption by approximately 13% as compared to the 
PACPA and RUAEE approaches. The results of EAMA are promising, and it can be 
concluded from the results that the proposed approach is a suitable competitor for VM 
migration across the CDCs. 


7. Conclusions and Future Work 


Energy consumption and environmental sustainability of modern CDCs have become a 
major concern for Cloud service providers (CSPs). Due to the increasing demands for Cloud 
services, CSPs are interested in the realization of energy-efficient methods to significantly 
reduce energy consumption. In this paper, we present a EAMA VM migration and placement 
approach that significantly improves the energy consumption and QoS provisioning in CDCs. 
The proposed approach is based on the principle of migrating VMs from overloaded hosts to 
under-loaded hosts while keeping the location (of VMs/users) intact with less delay that 


ultimately leads to a reduction in energy consumption. The obtained results demonst rate net 
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